Papers with document embedding
Unsupervised Keyphrase Extraction by Jointly Modeling Local and Global Context (2021.emnlp-main)
Copied to clipboard
| Challenge: | Embedding based methods are widely used for unsupervised keyphrase extraction tasks. |
| Approach: | They propose a method where local and global contexts are jointly modeled. |
| Outcome: | The proposed method outperforms most models while generalizing better on input documents with different domains and length. |
Every Document Owns Its Structure: Inductive Text Classification via Graph Neural Networks (2020.acl-main)
Copied to clipboard
| Challenge: | Existing graph-based methods for text classification cannot capture contextual word relationships within each document nor can they produce inductive learning of new words. |
| Approach: | They propose to use Graph Neural Networks to learn the local word representations and then aggregate the word nodes as the document embeddings. |
| Outcome: | The proposed method outperforms state-of-the-art methods on four benchmark datasets. |
STRASS: A Light and Effective Method for Extractive Summarization Based on Sentence Embeddings (P19-2)
Copied to clipboard
| Challenge: | Summarization is a costly and timedemanding task. |
| Approach: | They propose an extractive text summarization method which leverages the semantic information in existing sentence embedding spaces. |
| Outcome: | The proposed method performs similarly to state-of-the-art extractive methods with effective training and inference time. |
Fake News Detection Strategies under Dataset Bias: Using Large-scale Coarse-grained Labels (2026.eacl-srw)
Copied to clipboard
| Challenge: | Existing datasets differ substantially in content distributions and annotation policies, complicating fair evaluation and generalization assessment. |
| Approach: | They quantitatively analyze dataset bias across multiple public fake news datasets with different annotation granularities, including article-level and publisher-level labels. |
| Outcome: | The proposed approach improves detection performance under in-dataset and cross-data set evaluation settings. |
Unsupervised Learning of Discourse-Aware Text Representation for Essay Scoring (P19-2)
Copied to clipboard
| Challenge: | Existing document embedding approaches focus on capturing sequences of words in documents . however, some document classification and regression tasks need to consider discourse structure of text . |
| Approach: | They propose an unsupervised approach to capture discourse structure in terms of coherence and cohesion for document embedding that does not require expensive parsers or annotation. |
| Outcome: | The proposed method improves essay Organization scoring and Argument Strength scoring. |
Document Embedding Enhanced Event Detection with Hierarchical and Supervised Attention (P18-2)
Copied to clipboard
| Challenge: | Existing methods for event detection use sentence-level contextual information. |
| Approach: | They propose a document embedding enhanced bi-RNN model to detect events in sentences . they use hierarchical and supervised attention based RNN to learn document embeds . |
| Outcome: | The proposed model compares with state-of-the-art models on a ACE-2005 dataset. |
Hi-Transformer: Hierarchical Interactive Transformer for Efficient and Effective Long Document Modeling (2021.acl-short)
Copied to clipboard
| Challenge: | Existing approaches to model long documents are difficult due to the quadratic complexity of text length. |
| Approach: | They propose a hierarchical interactive Transformer for efficient long document modeling. |
| Outcome: | Extensive experiments on three benchmark datasets validate the efficiency and effectiveness of Hi-Transformer in long document modeling. |
QAEncoder: Towards Aligned Representation Learning in Question Answering Systems (2025.acl-long)
Copied to clipboard
Zhengren Wang, Qinhan Yu, Shida Wei, Zhiyu Li, Feiyu Xiong, Xiaoxing Wang, Simin Niu, Hao Liang, Wentao Zhang
| Challenge: | Modern QA systems entail retrieval-augmented generation (RAG) for accurate and trustworthy responses, but the inherent gap between user queries and relevant documents hinders precise matching. |
| Approach: | They propose a retrieval-augmented generation (RAG)-based approach to bridge this gap by attaching document fingerprints to the embedding to estimate the expectation of potential queries. |
| Outcome: | Experiments across diverse datasets, languages, and embedding models confirm the proposed solution is simple-yet-effective with zero additional index storage, retrieval latency, training costs, or catastrophic forgetting and hallucination issues. |
HILL: Hierarchy-aware Information Lossless Contrastive Learning for Hierarchical Text Classification (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing self-supervised methods in natural language processing rely on augmentation rules to generate contrastive samples. |
| Approach: | They propose a hierarchy-aware information lossless contrastive learning scheme that uses syntactic information reserved in the input sample and fused during the learning process. |
| Outcome: | The proposed learning scheme is superior to existing methods in hierarchical text classification . the proposed learning system is based on a structure encoder and a text encoder . |
CEMTM: Contextual Embedding-based Multimodal Topic Modeling (2025.emnlp-main)
Copied to clipboard
| Challenge: | CEMTM is a context-enhanced multimodal topic model that can infer coherent topic structures from documents . traditional multimodal topics failed to capture deeper cross-modal interactions . large vision language models (LLMs) and LVLMs have shown remarkable capacity to encode rich semantic knowledge from vast corpora. |
| Approach: | They propose a context-enhanced multimodal topic model that uses tokens to weight contributions to topic inference. |
| Outcome: | The proposed model outperforms unimodal and multimodal benchmarks on six multimodal domains and captures semantics in scientific articles. |